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Abstract  -  The  information  capacity  of  the  Poisson  channel  with  jamming  and  nonran¬ 
dom  time-varying  noise  intensity  is  obtained  for  a  time-varying  peak  constraint  on  the 
encoder  intensity.  The  optimal  jamming  signal  is  determined.  Feedback  is  shown  not 
to  increase  the  channel  capacity  for  the  case  of  nonrandom  noise  intensity.  Poisson 
channels  with  thinning  .are  introduced,  __ 


$ 


DTIC 


ELECTE 
APR  2  8  1989 


Supported  by  ARO  Contract  DAAL03-86-G-0022  and  ONIi  Contract  N0001-4-86-K-0039. 

These  results  were  presented  in  part  at  the  22nd  Annual  Conference  on  Information  Sciences  and 
Systems,  March  16-18,  1988,  Princeton  University. 

i  DTSTFUtBUflolN  kVATEMEIH’  A  1 


Approved  ior  public  tm** 
Distribution  Unlimited 


Kf  \j  is 


i  «» 


DO  FORM  1473,  83  APR  eoition  of  i  j*n  73  is  obsolete.  UNCLASSIFIED _ 

SECURITY  CLASSIFICATION  OF  THIS  FAG6 


I.  Introduction 


Optical  communications  systems  modeled  by  a  Poisson  channel  (Fig.  1)  are  described  in  [6], 
[10],  [11],  [12],  [13],  and  [15].  The  noise  intensity  (shown)  in  the  channel  model  represents,  nomi¬ 
nally,  noise  due  to  background  radiation  as  seen  by  the  receiver.  In  this  role,  modeling  the  noise 
intensity  by  a  real  constant  may  not  be  adequate.  For  example,  models  in  which  the  noise  (-plus- 
signal)  intensity  is  the  magnitude  of  a  time-varying  Gaussian  vector  appear  in  the  literature  [8], 
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Figure  1.  Poisson  channel  model. 


Besides  representing  background  radiation,  the  noise  intensity  in  the  channel  model  may  be 

used,  also,  to  represent  a  variety  of  other  features  of  the  modeled  optical  system.  Background 

radiation  will  generally  have  a  much  wider  spectrum  than  that  of  the  channel  source.  Thus,  the 

optical  filter  used  in  the  receiver  to  reduce  the  apparent  background  radiation  may  be  factored 

into  the  noise  intensity.  The  dark  current  generated  in  the  receiver  photon  detector  adds  to  its 

output  current  and  is  another  source  of  noise.  This  noise,  when  referred  back  to  the  receiver 

input,  contributes  to  the  channel  noise  intensity.  The  receiver  may  be  illuminated  by  a  jammer  - 

another  noise  source.  Also,  imperfect  encoder  modulation  (where  the  encoder  is  never  completely _ 

on  For 

off  or  intersymbol  interference  is  present)  in  effect  contributes  to  the  noise. 

For  many  optical  systems,  the  encoder  in  the  channel  model  is  interpreted  as  modulating  ,COjj 

the  envelope  of  the  output  of  a  photon  source.  The  photon  detector  receiving  the  stream  of  pho  '  1  0n~ 

tons  operates  with  a  certain  efficiency  q  <  1;  meaning  an  incident  photon  generates  an  electron-  - 

it  ion/ _ _ _ 

hole  carrier  pair  with  probability  q  .  Three  types  of  photon  detectors  are  commonly  considered  in  Codes 

^11  and/or 


•a  ki  w/ 


no 
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direct  detection  optical  receivers  [4]:  p-i-n  photodiodes,  avalanche  photodiodes,  and  photoconduc¬ 
tors.  Most  present  fiber  optic  systems  use  the  p-i-n  photodiode;  however,  the  internal  gain  of  the 
avalanche  photodiode  makes  it  an  increasingly  attractive  choice.  Carrier  pairs  generated  in  the 
avalanche  photodiode  go  on  to  generate  additional  pairs  by  a  process  of  collision  ionization 
depending  upon  the  type  of  carrier  (hole  or  electron),  the  semiconductor  material  out  of  which  the 
device  is  constructed,  and  the  voltage  across  the  device.  The  current  generated  by  collision  ionizar 
tion  has  a  message  dependent  noise  component. 

Background  radiation,  optical  filtering,  dark  current,  jamming,  imperfect  encoder  modula¬ 
tion,  conversion  efficiency,  and  collision  ionization  -  because  of  these  and  other  factors,  the 
engineer  may,  in  the  design  and  analysis  of  optical  communications  systems,  endow  the  channel 
noise  intensity  with  a  rather  rich  structure.  Thus  a  complete  theory  of  channel  capacity  for  the 
Poisson  channel  should  address  time-varying,  random  noise  intensities  dependent  on  the  message 
process  9.  In  this  paper  we  take  several  steps  in  this  direction  and  give  channel  capacity  results 
for  time-varying  noise  intensity  and  time-varying  encoder  constraints.  Results  for  jamming  are 
also  given.  To  begin,  we  specify  the  channel  model  and  recall  some  definitions  from  information 
theory. 

The  Poisson  channel  model  addressed  in  this  paper  is  represented  in  Figure  1.  The  channel 
output  Y  =  {  Yt  }o<i<r  is  a  Poisson-type  (simple)  point  process  directed  by  the  stochastic  inten¬ 
sity  r)t  =  Xt  +  Ae  •  Y  and  the  message  process  9={9t  }o<i<r  are  defined  on  a  common  probabil¬ 
ity  space  (0,JF,P)  with  respective  completed  natural  histories  F,'  and  FtY.  The  message  9  is 
encoded  into  the  channel  encoder  output  via  the  encoder  intensity  Xt .  Xt  —  Xt  is  required 
to  be  an  F,*v  Fty  -adapted  encoding  of  the  message  process  9  and  channel  output  Y  permitting 
causal  message  encoding  and  noiseless,  nonanticipative,  instantaneous  feedback.  The  channel 
noise  process  Nt  is  the  Poisson-type  point  process  directed  by  the  intensity  A, .  We  take  the 
processes  9  and  N  to  be  independent  and  impose,  on  the  encoder  intensity,  a  time-varying  peak 
constraint 

0  <  Xt  <  e(0  (1) 

for  all  t  €  [0,7’]  where  c  (< )  is  nonnegative,  bounded,  and  Lebesgue-measurable  or  an  average  con¬ 


straint 
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E[Jxt  dt]<k0T 


(2) 


for  some  positive  constant  kQ.  We  treat  the  case  in  which  the  noise  intensity  is  time-varying  and 
deterministic:  A(  =  \(f ).  Further  discussion  of  the  Poisson  channel  model  can  be  found  in  [l],  [3], 
[7],  and  [15|  and  the  references  cited  therein. 

To  define  channel  capacity  let  fit,  ft  y ,  and  fitr  be  the  marginal  and  joint  measures  induced 
by  the  message  and  output  processes,  9  and  Y,  on  the  spaces  S#,  Sy ,  and  StXSr  where  5*  and 
Sr  are  the  spaces  of  trajectories  of  6  and  Y  on  [0, 71  ] .  Write  the  induced  product  measure  as 
fitx  r  •  Then,  the  average  mutual  information  in  6  and  Y  over  the  interval  [0,T]  is 


It{0,Y]  =  e 


In 


d  n$r 
d  fiixr 


provided  utr  «t*txr;  otherwise  IT  [9,Y]—oo.  The  channel  information  capacity  is 

C  =  sup  sup  J_/r[0  y] 

|  X  J  L  »  J 


where  9  is  any  jointly  measurable  process  on  [0,7’j  and  \t  =  \t  (&,  T)  is  any  F,'v  F,r  -adapted 
mapping.  For  the  Poisson  channel  more  revealing  expressions  for  the  average  mutual  information 
are  [Theorem  19.3,  9]: 


It[9,Y]  =  E 


-  r)t  ln»7«  )dt 


(3) 


and 


It[9,Y\  =  E 


‘T 

-  »?,  In r\t)dt 

0 


(4) 


where  rft  =  E  [ve  |  Fj*].  These  expressions  are  valid  for  nonrandom  noise  intensities. 
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n.  Channel  Capacity  for  Time- Varying  Nonrandom  Noise  Intensity 


The  capacity  of  the  Poisson  channel  is  known  for  the  case  in  which  the  noise  intensity  is  a 
real  constant,  A,  =  X.  For  non  time- varying  peak-constrained  encoder  intensity  c(t)  =  e  (no 
average  constraint  imposed),  Kabanov  [7]  showed  the  channel  capacity  to  be 

C  =  C(X,c  )  (5) 

where 

+  +  (6) 

We  show  by  way  of  Lemmas  1,2,  and  3  and  Theorem  4  that  the  approach  taken  by  Kabanov  can 
be  adapted  to  extend  his  result  to  the  case  in  which  the  noise  intensity  is  nonrandom  and  time- 
varying:  A,  =  \(t )  and  in  which  the  peak  constraint  is  also  time-varying.  Lemma  1  treats  the 
case  in  which  X(l ),  c  (t )  are  simple  functions.  Lemma  2  goes  on  to  treat  extended  real-valued  sim¬ 
ple  functions  X(t ).  Then  in  Theorem  4,  for  time-varying  noise  intensity  X(< )  and  time-varying 
peak-constrained  encoder  output,  we  obtain  the  general  result 

,  r 

C  =  ±IC(\(t),c(t))dt  .  (7) 

1  o 

Note  that  when  the  noise  intensity  and  peak  constraint  are  constant,  X(< )  =  X  and  e  (/ )  =  e  ,  (7) 
gives  C  —  C(X,c  )  in  accordance  with  (5). 

In  the  proof  of  Lemma  1  a  sequence  of  message  processes  ^  and  an  encoding  scheme  x  are 
introduced  which  give  average  mutual  information  in  the  channel  arbitrarily  close,  as  m  — >-oo,  to 
the  channel  capacity.  The  encoding  scheme  there  does  not  use  feedback.  So,  for  nonrandom  time- 
varying  noise  intensity,  feedback  does  not  increase  channel  capacity,  i.e.,  the  average  mutual 
information  in  the  channel  can  be  made  arbitrarily  close  to  the  channel  capacity  without  use  of 
feedback  if  the  message  process  0  and  the  encoding  scheme  \  are  appropriately  chosen.  This  is  so 
when  the  encoder  intensity  is  peak-constrained,  average-constrained,  or  both. 

Davis  (3[  extended  Kabanov’s  result  (5)  to  reflect  the  imposition  of  an  average  constraint  on 
the  encoder  output.  Davis’  reasoning  applies  as  well  to  the  case  of  time-varying  noise  intensity. 
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We  find  that,  for  nonrandom,  time-varying  noise  intensity  X(f)  and  an  encoder  intensity  both 
peak-  and  average-constrained  as  per  (1)  and  (2)  with  c  (/ )  =  c  ,  the  channel  capacity  is 


C 


if 


-  4>(k0,\(t  )) 


dt  ,  for  k0  <  — 
e 


T 

±.fC(\(t),c)dt  ,tork0>j 
1  o 


(8) 


where  X(f )  *  X0  is  the  minimum  of  X(0  and  X0, 

<t>( x  ,y )  =  (*  +y  )ln(ar  +y)  -  y  lny  , 


and  X0  is  uniquely  defined,  for  —  <  k0 

c  « 


<4.  fey 


/tn=  — U  +  ^ 
A0 


1+Xq/c 


-  Xn 


Of  course,  the  average  constraint  is  inoperative  when  ko  >  e  ;  now  we  see  from  (8)  that  the  aver¬ 
age  constraint  is  inoperative  even  when  k$>  c  /2.  (8)  adjusts  in  the  obvious  way  to  accommodate 
a  time-varying  peak  constraint  c  (t ). 

We  close  this  section  with  one  final  result  for  the  capacity  of  the  Poisson  channel.  We  still 
suppose  that  the  encoder  intensity  is  peak-constrained  0  <  Xt  <  c  (0  but  no  longer  take  e  (t )  to 
be  a  given  function.  Instead,  we  suppose  c  (t )  may  be  chosen  freely  subject  only  to  the  constraint 

4 Jc{t)4t  <P 
1  o 

for  some  given  P  >  0.  Then  for  a  known  nonrandom  noise  intensity  A,  =  \(t)  the  channel  capar 
city  is  found  to  be  C  =  P  /e  •  The  proof  of  this  result  (Theorem  6)  given  in  Section  V  recognizes 
the  need  to  concentrate  the  power  e(t )  available  to  the  encoder  into  as  short  a  time  interval  as 
possible.  Thus  one  obtains  average  mutual  information  in  the  channel  closer  and  closer  to  P /« 
by  choosing 
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and  letting  |  A  j  — *■  0.  This  is  reminiscent  of  Davis’  result  [3]  for  polarization  modulation.  Davis 
showed  that  channel  capacity  is  maximized  when  encoder  power  is  not  distributed  over  two 
orthogonally  polarized,  separately  modulated  channels  but,  instead,  is  concentrated  solely  in  one 
channel.  This  was  because  of  the  convexity  of  C(x  ,y  )  in  y  .  For  this  same  reason  it  is  also  better 
not  to  distribute  encoder  power  over  time  but,  rather,  to  concentrate  it  into  as  short  a  time  inter¬ 
val  as  possible.  Also,  concentration  of  the  encoder  intensity  into  a  short  interval  permits  it  to  be 
very  large;  swamping  out  whatever  noise  intensity  may  be  present  in  that  interval.  Hence  the 
result  that  \(t )  does  not  appear  in  the  expression  for  the  capacity  C  —  P  /  e  . 
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m.  Jamming 


In  this  section  we  present  results  for  the  Poisson  channel  subjected  to  jamming.  We  make 
the  presence  of  jamming  explicit  in  the  channel  model  by  taking  the  channel  intensity  to  be 
Vt  —  Xt  +A,  +J(t )  where  J(t ),  the  jamming  intensity,  is  known,  deterministic,  nonnegative,  and 
Lebesgue- measurable.  We  do  not  consider  stochastic  jamming  intensities.  Restricting  attention  to 
channels  with  nonrandom  noise  intensity,  At  =  \(t ),  we  have 

nt  =  xt  +  MO  +  J(*)  •  (9) 

Then  by  Theorem  4,  for  a  peak-constrained  encoder,  the  channel  capacity  is 

1  r 

47  =  ±/C (Mt  )+J(t),c  (t))dt  . 

1  o 

(If  the  encoder  is  also  average-constrained  we  have  the  result  analogous  to  (8)). 

In  general,  the  jammer  seeks  to  minimize  the  channel  capacity  subject  to  constraints  on  the 
jamming  intensity.  If  the  jamming  intensity  is  peak-constrained,  J(t)<cj  for  some  c}  >  0,  the 
solution  is  immediate.  The  optimal  choice  of  jamming  intensity  is 

=  cj  a.e. 

(because  C(x,y)  is  positive  and  strictly  decreasing  in  x).  A  more  interesting  problem  arises  when 
the  jamming  intensity  is  average-constrained, 

T 

J  J(t  )dt  <  PT  . 

0 


For  this  case  (Theorem  5), 


J^(t)  =  [a-X(t)]+  a.e. 


where  a  is  determined  from 

T 

/[o-X(t)]  +  <f<  =  PT 
0 


(10) 
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and  z+  is  the  positive  part  of  x  €ft  .  Of  course,  other  constraints  or  combinations  of  constraints 
may  be  imposed  on  the  jamming  intensity,  leading  to  different  forms  for  the  optimal  jamming 
intensity. 

IV.  Thinning 


Signals  transmitted  through  a  Poisson  channel  can  be  viewed  as  a  train  of  point  events.  The 
Poisson  channel  noise  process  corrupts  the  signal  by  interjecting  extra  points  into  the  train  of  sig¬ 
nal  points.  One  can  just  as  well  imagine  the  signal  to  be  corrupted  by  removal  of  points.  This 
kind  of  signal  corruption  is  called  thinning.  Thinning  can  be  used  to  model  an  absorptive  channel 
medium,  optical  filters  in  the  receiver,  or  conversion  efficiency  of  the  receiver  detector.  Thinning 
may  operate  alone  in  a  point  process  channel  or  in  concert  with  some  form  of  Poisson  noise.  The 
case  in  which  points  are  removed  (or  not)  independent  of  the  removal  of  other  points  is  called 
independent  thinning. 

Definition:  Let  C,  be  a  point  process  with 

Ct  —  E  l|T,.oo)(*  ) 

*-o 

where  {  7*  }  is  a  sequence  of  stopping  times.  Let  }  be  a  sequence  of  i.i.d.  Bernoulli  r.v.s  with 
P{Pk  =  1}  =  P (7* ).  Then 

Ct  =  E  A 

*-  0 

is  a  probability-p  (t )  independently  thinned  point  process. 

While  many  different  types  of  thinning  are  conceivable,  independent  thinning  is  dis¬ 
tinguished  by  being  simple  in  concept,  by  being  motivated  by  physical  considerations  and  by 
easily  admitting  results  for  channel  capacity.  In  particular,  probability-p  (t )  independent  thinning 
of  a  Poisson  process  with  intensity  i(< )  produces  a  Poisson  process  with  intensity  p  (t)i(t)  [2], 

Consider  the  Poisson  channel  with  noise  intensity  At  =  X(f )  for  0<t  <T  and  suppose  the 
noise  is  probability-p  (t )  independently  thinned.  Let  the  encoder  intensity  \(  be  F<Y-‘ F,* 
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-adapted  with  peak  constraint  0  <  Xt  <  c  (f )  and  suppose  the  encoder  output  is  probability- <j  (t ) 
independently  thinned.  Finally,  suppose  the  thinnings  of  the  encoder  output  and  the  noise  are 
independent.  A  probability-^  (t )  independently  thinned  encoder  output  with  peak-constrained 
intensity  0  <  Xt  <  e(t )  is  equivalent  to  an  unthinned  encoder  output  with  intensity  constraint 
0  <  Xt  <  c  (t)q  (t ).  Thus  the  channel  capacity  is 

1  T 

C  =  ~fC(p(l)X(t),9(t)e(t))dt  . 

1  o 

For  p  ( t  )=g  ( t  )~p, ,  thinning  reduces  the  capacity  by  a  factor  of  pt : 

T 

C  =  ^rfC(\(t),e(t))dt  . 

1  o 

(Here  we  have  used  C(xz  ,yz  )  =  zC(x  ,y ).) 


-  10- 


V.  Results  and  Proofs 

Lemma  1:  Let  the  Poisson-type  point  process  Y  =  {^}o<«<r  directed  by  the  intensity 
tjt  =  X  (t )  +  x,  be  the  output  of  the  Poisson  channel  with  noise  intensity  given  by  the  simple 
function 

M0=EM£,(0.  fe[o,ri, 

with  0  <  Xj  <  oo  for  all  j  and  such  that  { E ,  1  <  j  <  n  <  oo},  is  a  Lebesgue-measurable  partition 
of  [0,T]  (i.e.  the  Ej  are  Lebesgue-measurable  subsets  of  [0,7’]  and  the  union  of  the  E y  is  [0,7'].) 
Constrain  the  encoder  \t  —  Xt(&>Y)  to  be  an  FtY  -adapted  function  of  Y  and  the  message 
process  0  —  {0t  }o<t  <r  •  Further  require  that  0  <  x<  <  e  (< )  where  c  (t )  is  the  simple  function 

«  (0=  E*ilr,(t)>  tel°’Tl 

i- 1 

where  {F,- ,  1  <  i  <  /  <  oo}  is  a  Lebesgue-measurable  partition  of  [0, 7’]  and  0  <  r, ■  <  oo  for  all  . 
Then 

C  =  ±/C(X(t),c  ( t))dt  . 

•*  o 

Proof:  First  we  show 

1  r 

C  <  ±fC(X(t),c  (t))dt  . 

1  0 

rjt  =  X  (/ )  +  \t  is  bounded  so  by  (4),  applying  Fubini’s  theorem, 

T 

IT\6,Y\  =  /  lnqe|  -  E  [fit  Mi  ]  ]  dt 
0  1  J 

T 

-/[£Wx..M0)]-£W$.  A  (/  ))]1  dt 
0  1  J 

-EE/  [^Wx«.Xy)]-£Wx«,x,-)]]A 

y-i  •'-!  E,r\F,  L 
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since  X  (t )  =  Xy  for  t^Ej .  I  =  — i—  >  0  for  x  ,y  >  0  so,  by  Jensen’s  inequality, 

dx2  *  +V 

E  [4>(Xt  Ay)]  >  4»(P[Xt]Ay)  • 

Using  E  [x*  ]  =  E  [x»  ]  and  <t>}-  (i )  =  4>{x  ,X; )  we  get 

IT[9,Y\  <S  E  /  r^l^(x«)]-^(^lXil)l*  • 
y— i  f— l  £,n/’1  L  J 

We  adopt  a  convenient  notation:  for  a  real  measurable  function,  j  , 

MO 

E  [j  (Xt )}  =  fg  (Xi  (w))P  {d  w)  =  jf  g(x)p  °Xt\dx  )  =  Q  ( g  )  . 
n  o 

Q  is  indexed  by  the  time  t ,  or  equivalently,  by  the  probability  measure  •P°xf1-  In  terms  of  Q  , 

it[o,y)<  E  E  /  ($(*>)- M«(i))]* 

/—i  *-i  £;nf, 

where  i  is  the  identity  function  i(x )  =  x .  Let  D,-  be  the  set  of  all  probability  measures  on 
([0,e,],JB([0,e,])).  Then 

iT\t.Y\<,  ±  Sieynr,iS8  [«(+/)-*/(«(!))] 

y-i  v-i  *  L  J 

where  |  Ej  flP,-  |  is  the  Lebesgue  measure  of  the  set  E ,■  PlF,- .  Therefore 

^  <  4E  E  I  EjDFi  |  f«(^)-^(g(i))l.  (ID 

1  y  —  i  «-i  '  L  J 

For  the  details  of  the  calculation  of  the  supremum  on  the  right-hand  side  of  (11)  we  refer  to  p.182 
of  [1{.  There  the  supremum  is  shown  to  be 

*uegt  [<?(*y)-«M<?0»]  —  <7(Xy.c.-) 
where  C(x  ,c  )  =  C(x  )  given  in  (6).  Hence 

T 

c  <  ^E  E  I  Ej df,  |  c(x,)  =  ±/c(x(0,c'  (*))*  ■ 

7  y-i  f-i  o 


Now  we  show 
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T 

C  >  —fC(X(t),c  ( t))dt  . 
1  0 


Our  approach  is  to  find  a  sequence  of  message  processes  and  an  encoding  x  such  that 


lim  ±IT  [*-\Y\  =  ±/C(\(t),c  (t))dt  . 

m  — *oo  i  1  n 


(12) 


To  construct  {^m*}  first  define  a  sequence  {0m^}  of  /  X  n -dimensional  matrices  of  independent 
telegraph  signals  Vj-j”  «  =1,2,...,/,  j  =  l,2,...,n ,  i.e.,  right-continuous  homogeneous  Markov 
jump  processes  with  states  {0,1}  (Chapter  3  of  (5j).  We  choose  the  processes  m  >  1,  to 

have  infinitesimal  parameter  matrices 


Q(-»)  = 


koo  9  oi 

o 

-m 

m  (1-p  )/p 


m 

-m  (1-p  )/p 


where  p  =  k}-  /  c,-  with 


Also,  for  nt  >  1,  let  P  {  =  1}  =  p  so  that  V,}”)  is  stationary.  Then  define  0*m  *  for  all  m  >  1 

as 


0/m>  = 


i 

£ 


where 


t 

t(0  =  /l E.nF,(')d«  ■ 
o 


Also,  let  x»  (0,Y)  —  c  (t)9t .  Then 

T 

lT{(t”),Y}  =  J  \e\4>(c  (l  ( t))l-EMc(t  )0/"»,X  (/ )))]  dt 

=  ES  /  \e  (<A(C|  ,X, )]  -  E  Wc,.  ,X,- ))  1  dt 

J=1  ,=1  Bjr\Fl  L 

„  «  r  1 

=  EE  /  F  ^  V‘W  H  ~  E  ^  <c*  W )i  r r  • 

/-I  1-1  0  L  J 
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Now 

E\*te  VilS')]  =  0y(O)P  {VW=0}  +  4>,  {ci)P  {V,j^=l}  =  p  0,  (c.  ) 
since  «£,-  (0)  =  0  and  P  {  V>,  *=1}  =  p  .  p  (e,- )  -  +}  (pc,- )  =  C  (X}-  ,c, )  so, 


IT[0,Y}=  t  S 

i-i i-i 


/  [c  (X,-  ,C,-  )  +  (pc,-  )  -  £  [*,  (c.  ) )]  J  d  T  . 


Thus  to  show  (12)  and  complete  the  proof,  it  only  remains  to  show 


lim  E  [$j  (e,-  V|-j"))j  =  0/(pc,-) . 


The  derivative  of  <f>j  is  bounded  on  [0,e,-],  say  by  a  constant  M ,  so 
I  *i  ('<  V<\mt  ’)  -  4>i  ( Pc,- )  |  <  Me,-  I  V.W-P  |.  Then 

I  E  [<6y  (c,-  Vi)mt  >)]  -  (pc,- )  |  <  E  [  |  ( c,-  V(\nt  >)  -  4>i  (pc, )  |  ] 

<Mc,-£[|  vW-p  |] 

<Mc,-  [e(\  W-p  I2]] ‘/2 
<Mc,-  [Bl^'Vpf78. 

Beginning  on  p.  184  of  [l)  it  is  shown  that  lim  E  [  2]  =  p2  so  the  proof  is  completed. 


Lemma  2:  C(x  ,e  )  —*■  0  as  x  — ►  oo  so  C(oo,c  )  s  0.  Then,  with  the  encoder  intensity  peak- 
constrained  by  the  nonnegative  simple  function  c  (t ), 

1  T 

C  =  (t))dt 

1  o 

for  all  nonnegative  extended  real-valued  simple  functions 

M0=  EM*,(0 


where  0  <  Xy  <  oo. 
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Proof:  We  need  only  consider 


MO  =  EMMO 


where  X,  =  oo  and  0  <  Xy  <  oo  for  /  <  n  .  Define 


Then,  using  (3), 


IT[0,Y)  =  jE[f  (Ht);Xt))dt 


=  E  fE[n\r>Xt)\dt  (is) 

/-I  E] 

since  /  ( x  ;Xt )  -*  x<  -  x»  as  x  — ►  oo  so  that 

f  E[f  (X«  ;x«  )]dt  =  jE[xt  -Xt]dt  =0. 

IT  [0,Y]  is  given  by  (13)  for  any  choice  of  9  and  x  so 

^  =  4 E  E  I  E)nF<  I 

1  y« i i»i 


C(\n  ,«.)  =  C,(oo,«,  )  =  0sO 

T 

<C  =  4S  E  I  EfnFj  |  C(Xy,C,)  =  —fC{\(t),c  (t))dt  . 
1  y— i i-i  1  o 


Lemma  S  Let  the  channel  noise  intensity  \(t)  be  a  nonnegative  extended  real-valued  Lebes- 
gue  measurable  function  and  define  L  to  be  the  set  of  all  simple  nonnegative  extended  real-valued 
Lebesgue  measurable  functions.  Write  C  =  C(X)  to  show  the  dependence  of  the  channel  capa¬ 
city  on  \(t ).  Then 
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sup  inf 

X  >X  <C(X  )  <  <7(X)  <  X  <X  C(X  ) . 
X  X  iL 


Proof1.  We  prove  only  the  first  inequality;  the  second  is  shown  similarly.  Write 
IT  [0,Y]  =  IT  [0,Y ;\ J  to  show  the  dependence  of  the  average  mutual  information  on  X(<). 
According  to  (3), 

T 

It[0,Y;\}  =  /£[/(X(0;x,)]i*  • 
o 


/  (x  ;xt )  is  a  nonincreasing  function  of  x  since 
df  (*  ;Xt ) 


dx 


—  In 


*+x* 

(  X+Xt  j 

*+Xi 

x  +Xt 

for  all  x  >  0  . 


Consequently  /  T  [0,  Y  ;X]  >  I  T  [ 0 ,  Y  ,X  ]  for  any  X  e  L  with  X  >  X  on  [0,  T  ] .  Therefore 

i  sup  | 

-L/r[*,r:x]>x>x  -±r/T[0,r;X] 

1  X  *L  1 

and 


yIT[0,Y;\}  >  xTx  ±IT\0,Y* 
f  1  \  ^1/ 


sup  - 

^xs;pi/r[«,r;x 

X  T 


sup 

X  >X  C(X  ) 
X 


Theorem  4:  Let  the  output  Y  —  { Yt  }o<<  <t  of  a  Poisson  channel  be  directed  by 
*7e  —  X(( )  +  Xt  where  the  channel  noise  intensity  X(t )  is  deterministic,  nonnegative,  and  Lebes- 
gue  measurable  and  where  Xt  =Xt(9,Y)  is  f/’F/  -adapted.  Suppose,  for  some  Lebesgue- 
measurable  function  c  (< ),  0  <  Xt  £  e  (0  <  M  for  all  t  e[0,  T  ]  and  some  M  <  oo.  Then 

1  T 
1  0 


Proof :  Write  €  =  C{k,c  )  to  make  explicit  the  dependence  of  C  on  X(t )  and  c  (t ).  By  Lem¬ 
mas  2  and  3, 


inf 

C(X,c  )  <  X  <X  47(X  ,e  ) 
X 


jnf  inf 

<  X  <X  e  >e  d7(X  ,c  ) 
X  eL  c  eL 


_inf  inf  ,  7 

=  X  <X  e  >c  — / G (X  (f  ),c  (<))*  • 
i  «L  c  si  o 

C  is  bounded  so  C7(X  (f  ),e  ( t ))  is  a  bounded  simple  function  if  ^  €  L  and  c  e  L  .  Also  C  (x  ,y )  is 
strictly  decreasing  in  z  and  strictly  increasing  inysoX<X,c>e  implies  C(X  ,c  )  >  C(X,e  ). 
Define  k(t)=  C(\(t),e(t))  and  l  —  C(X  (t  ),e  (t )).  Then 

inf  .  r 

C(X,e  )  <  i  >h  ±fh  ( t)dt  . 
h^L  1  o 


h  =  C(\,e  )  is  Lebesgue-measurable  and  bounded  so 


inf  I  r  ,  7 

H  4/mo*  -  4/a  (o* 

h  *L  1  o  1  o 


(p.  79  of  [14]).  Thus 


T 

C  <  i/<7(X(f))*  . 
1  o 


Likewise,  starting  with  the  first  inequality  in  Lemma  3  it  can  be  shown  that 


,  7 

<?a4/c?(M0)* 

1  o 


and  the  result  follows. 
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Theorem  5:  Let  the  noise  and  jamming  intensities  of  a  Poisson  channel  be  deterministic, 
nonnegative,  and  Lebesgue  measurable:  A,  =  X(t)  and  Jt  =  J(t)  as  in  (9).  Let  the  channel 
encoder  output  be  peak-constrained  and  let  the  jamming  intensity  be  average-constrained, 

T 

±fj(t)dt<P,  (14) 


P  >  0.  Then  the  optimal  choice  of  jamming  intensity  is  (t )  =  J,{t)  a.e.  for 

/,(0  =  [o-X(0]+ 


(with  a  defined  as  in  (10).) 


Proof:  Write  €  =  C(\+J)  to  show  the  dependence  of  the  channel  capacity  on  X(t )  +  J{t ). 
We  shall  show  that 

C(\+Jt)  <  C(\+J)  (15) 

for  all  deterministic,  nonnegative,  Lebesgue  measurable  J  satisfying  (14). 

In  showing  (15),  only  J  satisfying 

1  r 

±fj(t)dt=P  (16) 

1  o 

need  be  considered.  This  is  so  since  if 

1  r 

-LfJ(t)dt  <P 
*  o 

then  there  exists  a  jamming  intensity  J\(t)  with 

I  T 

4//i(o*  -p 
1  0 

such  that  Jy>  J  on  [0,T]  giving  <7(X+/i)  <  £(X+/).  So  we  take  (16)  to  hold. 

Let  /  i,  /  2  be  nonnegative  extended  real-valued  Lebesgue  measurable  functions  on  [0 ,T\ 
such  that  /  j  < /  2  and  /  u  /2  are  real-valued  on  {t :  f  |(f )  c  /  )}.  Define 
A  *  {(t  ,z  ):  f  i(t)  <  z  <  f  2(t )}.  Define  the  set  function  £  such  that  £(A  )  =  €(f  x)  -  C{f  2).  £ 
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extends  to  a  measure  on  (X  ,S )  where  X  =  [0,T]x[0,oo)  and  S  is  the  cr-field  of  two-dimensional 
Lebesgue- measurable  subsets  of  X.  £  hereafter  denotes  this  extension. 

Define  x{t)  =  [X(l  )+/„(<)]  ~  (X(l )+./(! )].  Also  define 

A .  =  z(t)  <  z  <  \(t)+J(t)}  , 

At  —  {(t,z):  z(t)  <  z  <  X(<  )+•/»(<)}  • 

Let  m  be  two-dimensional  Lebesgue  measure  on  (X,5)  and  let  m  ,  £  be  the  restrictions  of  m  ,  £, 
respectively,  to  At  U-A* .  m  and  £  are  then  equivalent  finite  measures.  Also 

C(X+/)  =  <7(*)-KA.), 

C(X+7#)=  <C-(x)-KA»). 

To  complete  the  proof  we  show  £(A, )  <  £(Aj ). 

By  the  Approximation  Theorem,  there  are  finite  sequences 

{i?t  ,i?|,  ,**  } 

of  disjoint  closed  rectangles,  all  identically  sized, 

R'  ~  ]  X  [z*,z*  +  A,  ]  , 

Rj  —  [*/,«/  +  A,  ]  X  (*/,*/  +  A,  ]  ,  (17) 

A,  >  0,  A*  >  0,  with  R*  C  A« ,  Rj  C  At  for  all  » ,  j  such  that 

?(a.)  <  '£m')  +  e, 

f  — J 

Ka*)s  E  ?(*/)  +  * 

for  6  >  0  as  small  as  desired,  m  is  finite  and  m  «  £  so,  for  5  small  enough, 

». 

"»(A«)  <  £m(Rf)  +  e  , 

1—1 

m  {At )  <  E  "» (Ri)  +  € 

/- 1 


% 
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for  any  (  >  0.  Let  n  =  n,  *  .  Then 

Ka.)-6,  -  E  km  =  ±~W) , 

•  «»+l  i»i 

)  -  6tt  -  E  Hr!)  =  EK*/) 

y—  »+i  /-i 

where  0  <  <  6,  0  <  Stlt  <6,  and 

w*(A,)-€»-  E  m(R,*)=:  E”»W), 

<— « +i  »»»i 

m  (A4 )  -  e„  -  E  S»  (#/)  =  E  «  (^/) 
y— »+i  y-i 


(18) 


(19) 


(20) 


(21) 


where  0  <  e,  <  e,  0  <  eot  <e. 

With  the  rectangles  R*,  Rf,  1  <  «  <  n,  ,  1  <  /  <  nfc  ,  given  as  in  (17),  we  can  write 

3W)-A,  [<7(ifl-<W+A„0]. 

?(*/)  =  A.  (<?(*/)- <7  (*/  +  A„«)J. 

Also,  by  the  form  of  J„  (f ), 

essinf{z  :  (t,z)«  A,  }  >  esssup(z :  (t  ,z  )  e  A*  } 

so  that  zyt  +  A,  <  z  *  for  all  « ,  j .  The  partial  derivative  of  C(x  ,e  )  w.r.t.  x  is  strictly  increasing 
so 

C{zf,e  )  -  C(zf+A,  ,e  )  >  C(z<‘,c  )  -  <7(z,‘+At  ,c  )  . 


Thus,  for  all  i ,  j , 

1(R!)  >  !(R‘)  ■ 

Thus  (18)  and  (19)  can  be  combined: 


£(A» )  -  ?(A« )  >  f>o* 


+  E  HR!)  -  E  &Rfl  ■ 

y  «  %  + 1  t  =*  *  +1 


(22) 
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m  (/?,-*)  ==  m  (Rf)  tor  all  i,  j  so  from  (20)  and  (21)  comes 

m  {Ab )  -  m  (A,  )  =  -  c,  +  E  m  (Rj)  -  E  m  (/?,*)  . 

+1  i  —  a  +1 

Also  m  (A, )  =  m  (Aa  )  since 

T  T 

-//.(f)*  . 

0  0 

So 

E  »(*/)-  E  =  -£.«  • 

y— »+i 

Suppose  n  =  n,  .  Then 

E  mfRfl-o,  E  ?W)  =  0 

1— »+l 

so  that 

«* 

E  m  (Ri)  “«*-<«  s « . 

y-«+i 

Then,  for  any  7  >  0,  by  making  «  small  enough, 

E 

;  ■»«  +1 

since  £  is  finite  and  £  «  m .  Then  (22)  becomes 

?(A»)-3(A.)>*„  -tf.  -7- 

,  6, ,  7  may  all  be  made  arbitrarily  small  so  £(Ab )  >  £(A, ). 

Now  suppose  n  =  nb .  Then 

E  ?(/?/)  =  0 

y-»+i 


?(A6 )  -  ?(A.  )>6,t-6'  +  E  W)  *  6»  -  6o  ■ 

i  =»»  +1 


and 
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Again,  )  >  £{A, ). 

Theorem  6:  Suppose  the  encoder  intensity  Xt  of  a  Poisson  channel  is  ir,#v  f^-adapted  and 
peak-constrained  0  <  \t  <  c  (t)  with  c  (< )  e  T  where 

1  T 

r  =  {e(t)>0:±fc(t)Jt  <P}. 

1  o 

Also  suppose  the  channel  noise  intensity  is  nonrandom  A,  =  X(< ).  Then  the  channel  capacity  is 

c 

Proof:  By  Theorem  4, 

T 

sup  1 


1  n 


Define 


r,  =  {c(O>0:  ±fc(t)dt  =P} 

1  o 


Since  C  (x  ,y )  is  increasing  in  y , 


C(x  ,y )  is  decreasing  in  x  and  C(0,y  )  =  y  /«  so 

T 

f 

o 


O  <  S|P4/C( o,«(())*  -  -  A . 

ln  i  n  C  C 


Next  we  show  C  >  P /e  to  complete  the  proof.  Choose  L  >  0  and  let 
G  —  {<€[0,7’j:  \{t)  <  L  }.  Define  \L(t)  =  L  on  G  and  \L(t)  =  oo  on  [0,  T]/G.  Then 
C7(X(0,c(0)>C,(Xt(0.c(0)so 

c  >^r>p0^/c(xt(o.«(o)^ 
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=  ?€?,  f  >Po  ^fC{L,c(t  ))dt 
1  a 

=  LS>Pof HP±fC(L,c(t))Jt  . 

1  G 

Let  S  be  the  set  of  all  nonnegative  (Lebesgue- measurable)  simple  functions  on  [0,7*].  Then 

C  *  RP.  SP,  ?s  i/c(i ,«(.))" 

1 e  1  g 

=  r>Po«!^^(L,e  (t))dt 

1  a 

(«»■*  ■ 

i  <U  1  G 

C( z  ,y )  as  a  function  of  y  is  strictly  convex  and  strictly  increasing  for  *  >  0  so 

e*r|ns  —;f  C(L  ,e  (t))dt  =  ±fC(L,c  M{t))dt 

i  <u  1  a  1  a 

where  e  u(t )  =  M  lA  (t )  with  |  A  \  —  |  G  |  .  Then 

c  >  T%  ±/C(L  ,eM(t))dt 
*  a 

-l“&2‘frjC(LM)£\G  \ 

-  P  !UJ5  SfrjjCiL  M) 


=  p  n  - 

T 

-  SfPC(L/M,l) 

1! 

C"  w 

1 

m 

T 

-  lim  C{L/M,1) 

U  —oo 

II 

*■0 

t^OO 

*g 

1 

liLL 

T 

-  c(o,i). 

(7(0,1)  =  l/«  and  |  G  |  — *  T  as  L  —> ►  oo  so  the  proof  is  complete. 
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